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Abstract 

Background: Mild cognitive impairment (MCI) is considered to be an early stage of a neurode- 
generative disorder, particularly Alzheimer's disease, and the clinical diagnosis requires the ob- 
jective demonstration of cognitive deficits. The aim of the present study was to evaluate the 
predictive value of MCI for the conversion to dementia when using four different verbal mem- 
ory tests (Logical Memory, LM; California Verbal Learning Test, CVLT; Verbal Paired-Associate 
Learning, VPAL; and Digit Span, DS) in the MCI criteria. Methods: Participants were consecutive 
patients with subjective cognitive complaints who performed a comprehensive neuropsycho- 
logical evaluation and were not demented, observed in a memory clinic setting. Results: At 
baseline, 272 non-demented patients reporting subjective cognitive complaints were included. 
During the follow-up time (3.0 ± 1.9 years), 58 patients converted to dementia and 214 did not. 
Statistically significant differences between the converters and non-converters were present in 
LM, VPAL, and CVLT. A multivariate Cox regression analysis combining the four memory tests 
revealed that only the CVLT test remained significant as a predictor of conversion to dementia. 
Non-demented patients with cognitive complaints diagnosed as having MCI according to ab- 
normal (<1.5 SD) learning in the CVLT test had a 3.61 higher risk of becoming demented during 
the follow-up. Conclusion: The verbal memory assessment using the CVLT should be preferred 
in the diagnostic criteria of MCI for a more accurate prediction of conversion to dementia. 
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Introduction 

Many elderly people suffer from memory and other cognitive decline that is not severe 
enough to meet the criteria for dementia. These elderly people may be diagnosed as having 
mild cognitive impairment (MCI), implying a high risk of progression to dementia, usually 
Alzheimer's disease (AD), in the forthcoming years. In the initial formulation by Petersen et 
al. [1], MCI was based on (1) memory complaint, preferably corroborated by an informant; 
(2) memory impairment documented according to appropriate reference values; (3) essen- 
tially normal performance in non-memory cognitive domains; (4) generally preserved ac- 
tivities of daily living, and (5) absence of dementia. As repeatedly pointed out, several of these 
criteria would need operationalization. In particular, the test used to document the memory 
impairment and the cut-off score should be specified [2]. In spite of further refinements in 
the concept of MCI [3-10], there is still no consensus about the specific memory test that 
should be used for the diagnosis of MCI or prodromal phase of AD [11, 12]. Thus, there is the 
need to compare systematically and prospectively the inclusion of different verbal memory 
tests in the MCI criteria, and to examine how this modifies the predictive value of the MCI 
diagnosis for conversion to dementia. 

Deficits in episodic memory are associated with impaired encoding of the contextual 
information and consolidation of new verbal material [13-15], and a lower performance on 
tests of episodic verbal memory is a forerunner of future cognitive decline [16-19]. A deficit 
in delayed recall assessment of episodic long-term memory, as opposed to the short-term or 
implicit memory assessment, would be particularly characteristic of initial AD [20], since it 
reflects involvement of the hippocampus and related medial temporal lobe structures. Sig- 
nificant verbal memory impairment, confirmed by neuropsychological testing, is considered 
the hallmark of both amnestic MCI and AD [4, 21] . So far, distinct tests of memory and learn- 
ing have been used to establish the presence of memory impairment in order to fulfill the 
criteria for MCI, namely the Logical Memory (LM) test [19, 22-24], the Verbal Paired-Asso- 



ciate Learning (VPAL) test [23, 25], and the California Verbal Learning Test (CVLT) [17, 19, 



The LM test [32] has been used for a long time to discriminate between healthy older 
adults and individuals with very mild dementia [33] and is still commonly used for the as- 
sessment of memory impairment in MCI patients nowadays. Recent studies associate the 
presence of impairment in LM with a higher rate of conversion to AD as compared with 
other episodic memory tests [24, 34]. Furthermore, the LM test was recently proposed 
as a screening tool for MCI in the Alzheimer's Disease Neuroimaging Initiative (ADNI) 
study [35]. 

Previous studies showed that impairment in list learning tests might as well predict ac- 
curately the conversion to AD [17, 36]. Rabin et al. [19] showed that the impairment in the 
total learning score from the CVLT [37] had superior overall accuracy in distinguishing MCI 
from normal aging, even though that accuracy might be enhanced by the inclusion of the 
delayed recall condition of the LM test. The VPAL test was proposed to reveal the presence 
of memory deficits in MCI and AD patients, although the facilitation of the encoding process 
through the cued recall format could lead to a different memory deficit profile than in pa- 
tients assessed with the CVLT [25]. 

Besides verbal memory impairment, some studies have evidenced that other memory 
domains are also altered in MCI, namely those related to working memory [13]. The Digit 
Span (DS) test measures auditory attention, immediate span of learning, and working mem- 
ory. Impairment in the DS test was associated with future cognitive decline [38, 39]. How- 
ever, it appears that working memory does not decline early in the neurodegenerative process 
of AD [40]. Therefore, the DS test was used in this study as a negative control to other applied 



26-31]. 
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tests that represent earlier markers of the neurodegenerative process observed in AD patients 
(e.g., tests assessing episodic memory and verbal learning). Another type of memory that 
evidenced more resistance to AD progression is semantic memory, since the lexical semantic 
system might be spared until the initial phase of dementia [41]. 

In the present study, non-demented patients with cognitive complaints who had a neu- 
ropsychological battery assessing different types of memory were followed prospectively. 
The aim was to determine whether the inclusion of four distinct memory tests, i.e., LM test, 
CVLT, VPAL test, and DS test, in the diagnostic criteria could modify the predictive value 
of MCI regarding conversion to dementia. 



Methods 

Research Participants 

Participants were selected from the Cognitive Complaints Cohort [42], which is a pro- 
spective study conducted at the Institute of Molecular Medicine, Lisbon, to investigate the 
cognitive stability or evolution to dementia of subjects with cognitive complaints based on a 
comprehensive neuropsychological evaluation and other biomarkers. The study was ap- 
proved by the local ethics committee. 

Inclusion Criteria 

The inclusion criteria were: (1) presence of cognitive complaints; (2) neuropsychological 
testing including all four memory tests compared in the present study, and (3) follow-up >6 
months. 

Exclusion Criteria 

The exclusion criteria were: (1) presence of neurological or psychiatric disorders that may 
induce cognitive deficits; patients with major depression according to DSM-IV-TR [43] or 
serious depressive symptoms (indicated by a score on the Geriatric Depression Scale short 
version (GDS 15) of >10 points) were excluded; (2) systemic illness with cerebral impact; (3) 
history of alcohol abuse or recurrent substance abuse or dependence, and (4) presence of de- 
mentia according to DSM-IV-TR [43], or a Mini-Mental State Examination (MMSE) score 
below the cutoff for the Portuguese population, or significant impairment on activities of 
daily life according to the Blessed Dementia Rating Scale (BDRS) [44, 45]. 

Procedures 

The baseline comprehensive neuropsychological assessment was carried out by the same 
team of trained neuropsychologists, supervised by M.G., following a standard protocol and 
comprising several tests and scales: 

(1) MMSE [46, 47]: the MMSE is one of the most widely used brief instruments for the 
clinical evaluation of cognitive state in adults; 

(2) Battery of Lisbon for the Assessment of Dementia (BLAD) [48]: the BLAD is a 
comprehensive neuropsychological battery evaluating multiple cognitive domains and 
validated for the Portuguese population [48]. Tests of interest for the present study were: 
LM (immediate and delayed recall; Wechsler Memory Scale, WMS); VPAL (immediate 
recall; WMS), and DS (forward and backward; WMS) [32]; 

(3) CVLT [27, 37]: the CVLT measures verbal learning assessing constructs as repetition 
learning, serial position effects, semantic organization, intrusion, and proactive 
interference. The word lists (list A and list B) are made up of 16 items from 4 different 
categories of 'shopping list' items. The trials of interest (trials with better discriminating 
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ability for different stages of cognitive decline according to previous studies) [26] 
considered for the present study were: the total number of words from list A correctly 
recalled on the five learning trials (Atot) and long-delayed free recall (LDFR; number of 
words from list A correctly recalled after an interference period of 20 min); 

(4) BDRS [44, 45]: the BDRS is a brief behavioral scale based on the interview of a close 
informant, assessing functional capacity for activities of daily living and changes in 
personality; 

(5) Geriatric Depression Scale (GDS) [49-51]: the GDS is a self-report assessment used 
specifically to identify depression in the elderly For this study, a short-form (15 items) 
of the self-report instrument was used. 

Diagnosis of MCI 

Diagnosis of MCI was based on criteria given by the MCI Working Group of the Euro- 
pean Consortium on Alzheimer's disease [4]: 

(1) Cognitive complaints coming from the patients or their families; 

(2) The reporting of a decline in cognitive functioning relative to previous abilities during 
the past year by the patient or informant; 

(3) Presence of cognitive impairment: in this study, four distinct memory tests to fulfill this 
diagnostic criterion were compared: LM, CVLT, VPAL, and DS; 3 cutoffs to define 
impairment were also analyzed (1, 1.5, and 2 SD below the mean); 

(4) Absence of major repercussions on daily life (the patient may report difficulties 
concerning complex day-to-day activities). 

Patients were assessed at follow-up for the presence of dementia and diagnosis of AD, 
according to the DSM-IV-TR [43] criteria. 

Data Analysis 

Demographic, clinical, and neuropsychological data were analyzed using the Mann- 
Whitney U test for numerical data and Pearson x 2 test for nominal data. All tests were two- 
tailed and a p value of <0.05 was assumed as statistically significant. 

The neuropsychological assessment was standardized according to the age and educa- 
tion norms for the Portuguese population and z scores were calculated. The 1, 1.5, and 2.0 
SD cutoffs below the mean were compared for establishing impairment on the memory tests. 

Survival methods were chosen for analysis, since MCI conversion to dementia occurred 
at different times and the observations were censored. To explore the effect of impairment 
in different memory tests on the conversion to dementia during follow-up, univariate and 
multivariate Cox proportional hazards regression models were performed. For multivariate 
models, the Enter selection method was used to build the regression models. The memory 
tests were introduced as a binary variable (presence or not of impairment, coded as 0 and 1, 
respectively, and according to the cutoffs established, 1, 1.5, and 2.0 SD). Since converters to 
dementia were older at the baseline than non-converters, the multivariate model was adjust- 
ed for age. Survival time was calculated as the interval from the initial baseline evaluation to 
the diagnosis of dementia. For patients who remained non-demented, survival time was cen- 
sored at the date of the last clinical assessment. A forest plot with the estimated hazard or 
risk of conversion to dementia for the different memory tests and cutoffs was displayed. Sta- 
tistical analyses were performed using IBM SPSS Statistics 19 for Windows (2010 SPSS Inc., 
an IBM Company) and GraphPad Prism 5 for Windows (GraphPad Software, Inc., San Di- 
ego, Calif, USA) for graphical displays. 
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Table 1. Baseline demographic and clinic characterization data 





Converters 


Non-converters 


p value 




(n = 58) 


(n = 214) 




Age, years 


69.9 ±8.7 


66.2 ±9.3 


0.004*'* 


Gender (female/male) 


38/20 


122/92 


0.293* 


Formal education, years 


9.3 ±5.1 


10.1 ±4.8 


0.221* 


Follow-up time, years 


2.8 ±1.7 


3.1 ±1.9 


0.427* 


GDS 


4.8 ±3.7 


4.8 ±4.1 


0.831* 


BDRS 


3.4 ±2.5 


2.9 ±1.9 


0.450* 


MMSE 


25.4 ±2.5 


28.3 ±1.9 


0.001*-* 



Data are number of patients or mean ± SD. * Mann-Whitney test. * Pearson x 2 test. * Statistically sig- 
nificant (p < 0.05). 



Table 2. Verbal memory tests at baseline 







Converters 


Non-converters 


p value* 






(n = 58) 


(n = 214) 




LM 


Immediate recall 


-1.46 ±1.09 


-0.89 ±1.00 


<0.001* 




Delayed recall 


-1.61 ±1.11 


-0.84 ±1.08 


<0.001* 




Forgetting index 


-0.38 ±0.47 


-0.11 ±0.45 


0.001* 


VPAL 




-1.48 ±1.14 


-0.74 ±1.15 


<0.001* 


CVLT 


Five learning trials total 


-3.22 ±1.45 


-1.81 ±1.44 


<0.001* 




Long delayed recall 


-3.30 ±1.77 


-1.64 ±1.61 


<0.001* 




Forgetting index 


-0.11 ±0.65 


0.06 ±0.44 


0.142 


DS 


Forward 


0.40 ±1.63 


0.41 ±1.27 


0.837 




Backwards 


0.05 ±1.30 


0.30 ±1.15 


0.084 



Data are mean ± SD. Means of Z scores, calculated according to the equation [z = (x - mean)/SD]. 
Mann-Whitney test. * Statistically significant (p < 0.05). 



Results 

At baseline, 272 patients reporting subjective cognitive complaints and not demented 
were included. During the follow-up time (3.0 ± 1.9 years), 58 patients (21%) converted to 
dementia, and 214 (79%) did not. Most cases that progressed to dementia were diagnosed as 
AD (85%). The presence of depressive symptoms and functional capacity did not differ be- 
tween converters and non- converters (table 1). Likewise, the follow-up time was not signifi- 
cantly different between the two groups (table 1). The converters were older than the non- 
converters at the baseline assessment (table 1). Statistically significant differences between 
the converters and non- converters were present in all measures of verbal memory adminis- 
trated with the exception of the DS test and a measure of forgetting from the CVLT (table 2). 
The analysis of other neuropsychological tests from the BLAD also showed significantly 
lower performances in converters as compared to non-converters, namely in measures of at- 
tention, initiative, and conceptual thinking; however, all scores were within 1 SD of the 
mean, showing that the converters had no major impairments in non-memory cognitive do- 
mains that would qualify them for a diagnosis of dementia (results not shown). 
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Table 3. Number of subjects diagnosed as MCI according to distinct measures and cutoffs of memory tests 







1SD 


1.5 SD 


2 SD 


T AA n (0L\ 
JjJVl, \\ \ 7Q) 


Immediate recall 




1UO \ Jy ) 






Delayed recall 


137 (50.4) 


98 (36) 


55 (20.2) 


CVLT, n (%) 


Five learning trials total 


195 (71.7) 


166 (61) 


123 (45.2) 




Long delayed recall 


147 (54) 


117(43) 


91 (33.5) 


VPAL, n (%) 




132 (48.5) 


86 (31.6) 


47(17.3) 


DS, n (%) 


Forward 


31 (11.4) 


24 (8.8) 


3(1.1) 




Backward 


36(13.2) 


14(5.1) 


9(3.3) 



Of the 272 patients reporting subjective cognitive complaints and not demented, 33 
(12%) had no alterations at the baseline in the memory tests selected for the present study 
(considering the cutoff <1.5 SD), 72 (26%) had deficits at only 1 of the memory tests, 167 
(62%) showed deficits in > 2 memory tests (from those, 4 (2%) had deficits in at least 1 mea- 
sure of all memory tests). The number of patients diagnosed as having MCI based on each 
specific memory test and 3 different cutoff values is shown in table 3. The CVLT test was the 
verbal memory test that categorized more individuals as MCI across the 3 cutoffs (table 3). 

Since the conversion to dementia occurred during the follow-up time at different mo- 
ments, a survival analysis was performed. The diagnosis of MCI on the basis of an abnormal 
value for each of the memory tests, LM, CVLT, and VPAL, according to the cutoffs deter- 
mined for impairment, carried a significant risk of conversion to dementia during the follow- 
up (univariate Cox regression model fitted to the results of each memory test; fig. 1). The 
diagnosis of MCI on the basis of an abnormal value for the DS backward condition (all cut- 
offs) and forward condition (1 and 2 SD cutoffs) was not significantly associated with the risk 
of conversion to dementia during the follow-up (fig. 1). The three significant memory tests 
showed overlapping hazard risks for conversion to dementia (fig. 1). 

To test whether the verbal memory tests used in the diagnostic criteria of MCI (LM, 
CVLT, and VPAL) that individually had shown to accurately predict future conversion to 
dementia, could be combined to improve their predictive value, a multivariate Cox regres- 
sion analysis was performed. In an attempt to increase the power of multivariate analysis, we 
reduced the number of measures in the study and selected two at maximum for each mem- 
ory test. The measures not selected for the present study also showed overlapping hazard 
risks and did not add any further accuracy for predicting future conversion to dementia. In 
the multivariate Cox regression analysis only the CVLT (learning measure for the cutoff <1.5 
SD and long delayed recall for the other cutoffs) remained significant as a predictor of con- 
version to dementia (table 4). Non-demented patients with cognitive complaints diagnosed 
with MCI according to abnormal (cutoff commonly used of <1.5 SD) learning in the CVLT 
had a 3.61 higher risk of becoming demented in the follow-up as compared to those who had 
normal learning in the CVLT (table 4). 



Discussion 

The present study shows that different verbal memory tests, LM, CVLT, and VPAL, 
when used in non-demented patients with cognitive complaints to establish memory impair- 
ment in the diagnosis of MCI, are not significantly different to predict the progression to 
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s 



Digit Span backward (-2.0) - 
Digit Span backward (-1 .5 
Digit Span backward (-1.0) - 

Logical Memory, immediate (-2.0) - 
Logical Memory, immediate (-1.5 
Logical Memory, immediate (-1.0 



Verbal Paired-assoc.L. (-2.0; 
Verbal Paired-assoc.L. (-1.5 
Verbal Paired-assoc.L. (-1 .0] 

Digit Span forward (-2.0; 
Digit Span forward (-1 .5 
Digit Span forward (-1.0 

Logical Memory, delayed (-2.0; 
Logical Memory, delayed (-1 .5 
Logical Memory, delayed (-1 .0 

CVLT, long-delay free (-2.0 
CVLTflong-delay -1.5 
CVLT, long-delay (-1 .0. 



CVLT, five trials (-2.0; 
CVLT, five trials -1.5 - 
CVLT, five trials -1.0 - 




! I — 



Hazard ratios for memory tests 
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10 15 20 25 30 35 40 

Exp(B) 



Fig. 1 . Verbal memory tests and risk of progression to dementia (hazard ratios and confidence intervals 
from univariate Cox regression analysis). 



dementia. However, the MCI criteria using the CVLT had the highest predictive value, which 
was not improved by adding other memory tests. 

Although it has been argued that the use of a memory test battery offers a better sensi- 
tivity to the earlier diagnosis of MCI [52], we showed that only the CVLT remains significant 
on the multivariate Cox regression model as a predictor of progression to dementia, and 
other memory tests did not significantly add to the predictive value. The assessment of verbal 
memory based on list learning was found to be predictive of future conversion to dementia 
in earlier phases, possibly due to the reduced use of learning strategies [53]. Previous studies 
have also suggested that list learning represents a more demanding encoding test than story 
recall, is more sensitive to executive dysfunction, and offers a better prediction of conversion 
to dementia [19, 54, 55]. The higher frequency of impaired performance for CVLT at baseline 
highlights the demanding character of the task, indicating that it might be an early marker 
for cognitive decline [17]. 

Different measures of verbal memory tests used for the diagnosis of MCI may assess dif- 
ferent stages of the neurodegenerative process by relying on distinct cognitive resources, so 
the contribution to diagnostic accuracy and predictive value is unique [14]. Both measures 
of immediate and delayed free recall were analyzed, because there is some evidence that long- 
term memory is more extensively impaired in MCI patients than short-term memory and, 
more importantly, has evidenced a greater sensitivity for the identification of amnestic MCI 
which will progress to dementia [20]. Verbal memory impairment can possibly correspond 
to either a defective consolidation of information relying on an alteration of mesiotemporal 
areas, or to a difficulty in elaborative encoding and afterwards correct retrieval of informa- 
tion, which in this case is associated with an alteration of frontal areas. MCI patients at risk 
of conversion to AD are expected to present deficits in learning (encoding and storage) rath- 
er than in the retrieval process [56, 57]. Some verbal memory tests assess primarily the ca- 
pacity of storage, and for that aim semantic cues are systematically provided during the en- 
coding phase in order to facilitate the retrieval process. For instance, the Free and Cued Se- 
lective Reminding Test [58] assesses specifically the storage capacity of MCI patients with 
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Table 4. Verbal memory tests and risk of progression to dementia (multivariate Cox regression analysis) 
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0.53 
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0.58 
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l.DO 


U.07 - 4.UO 


l.Jl 
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Learning test 


Long delayed recall 


0.76 


0.49 


2.13 


0.81-5.60 


2.37 


0.12 


Verbal Paired Associate 
















Learning test 




0.55 


0.38 


1.73 


0.83-3.61 


2.12 


0.15 


Digit Span test 


Forward 


0.92 


0.53 


2.51 


0.89-7.06 
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Backwards 
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Five learning trials 


0.79 


0.55 


2.21 


0.75-6.54 


2.07 


0.15 


Learning test 


Long delayed recall 


1.45 


0.59 


4.26 


1.35-13.43 


6.11 
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Verbal Paired Associate 
















Learning test 




0.28 


0.43 


1.32 


0.57-3.05 


0.41 


0.52 


Digit Span test 


Forward 


-8.63 


408.64 


<0.001 


0.00-n.d. 


<0.001 


0.98 


Backwards 


-0.07 


1.03 


0.94 


0.12-7.11 


0.004 


0.95 


* Statistically significant (p < 0.05). 



focus on the amnestic syndrome of the medial temporal type associated with a future pro- 
gression to dementia [52, 53]. According to a recent review, the studies that determined the 
predictive value of this test for future conversion to dementia also evidenced that delayed 
recall measures were less sensitive and specific than immediate recall measures, supporting 
the hypothesis of a failure at the initial learning process (although providing semantic cues), 
instead of forgetting due to inadequate storage of the information [57]. Other studies have 
shown that MCI patients at risk of conversion to dementia (namely AD) could benefit from 
semantic cues on the encoding phase in a similar way as normal controls, suggesting that the 
deficits in encoding correctly the information during the learning process, and not a diffi- 
culty in the storage process itself, would lead to retrieval impairment [27, 57, 61]. 

Bearing in mind the above mentioned, we decided to examine the CVLT performance 
for the total learning and delayed recall, which are also the measures associated with a better 
discrimination between normal aging, MCI, and AD [26]. Verbal learning tests were ana- 
lyzed on associative (VPAL) and non-associative (CVLT) conditions in order to assess dif- 
ferent stages of impairment progression. Deficits in associative learning tests are present in 
a more advanced stage of progression in MCI [62] and, therefore, may not be the best predic- 



Dementia j 

and Geriatric * 
Cognitive Disorders 



Dement GeriatrCogn Disord Extra 2012;2:120-131 



DOI: 10.1159/000336224 
Published online: April 13, 2012 



©2012S. Karger AG, Basel 
www.karger.com/dee 



128 



Silva et al.: Comparison of Four Verbal Memory Tests for the Diagnosis of MCI 



tors for conversion at earlier phases. Interestingly, the use of different cutoffs for CVLT im- 
pairment did not considerably modify the risk of progression to dementia. 

The present results suggest that a measure of working memory, like the DS backward, 
should not be used to qualify for memory impairment in the MCI diagnostic criteria, and 
the prediction of future conversion to dementia would be unreliable. Working memory and 
visuospatial ability have been proposed as functions that decline slowly in MCI patients [63]. 
A recent study showed that subjects presenting subjective cognitive complaints and impair- 
ment in DS might have a higher risk of future conversion to MCI but did not compare the 
DS predictive value to other memory tests [38]. 

One limitation of the present study is the focus on a restricted number of verbal memo- 
ry tests commonly used in clinical practice to evaluate memory in non-demented patients 
with suspected cognitive decline. Clearly, it would be interesting to evaluate other memory 
modalities, with visual or semantic memory tests. Nevertheless, several studies showed that 
their diagnostic value in the identification of MCI patients at risk of conversion to dementia 
do not clearly overtake that of verbal episodic memory tests [18, 64-66]. Another limitation 
of the present study was that it focused on neuropsychological data, and other biomarkers 
were not considered. Recently, many studies have been published combining different bio- 
markers in non-demented subjects with cognitive complaints for predicting future conver- 
sion to dementia. Consequently, the choice of specific verbal memory tests in the neuropsy- 
chological assessment, in conjunction with other biomarkers, may be crucial to accurately 
predict future conversion to dementia. 

In conclusion, different memory tests, namely LM, CVLT, and VPAL, can be used to es- 
tablish the diagnosis of MCI and predict the progression to dementia. Considering our re- 
sults, the MCI criteria using the CVLT had the highest predictive value, which was not im- 
proved by adding other memory tests, and taking into account that there are frequent limi- 
tations in clinical practice to apply an extensive neuropsychological battery to all individuals 
with suspected cognitive decline [67], we propose that a list learning task could be the pre- 
ferred test to establish memory impairment in MCI diagnosis. 
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